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ON  SOME  VARIATIONAL  PROBLEMS  OCCURRING  IN 
THE  THEORY  OF  DYNAMIC  PROGRAMMING 


Richard  Bellman 
Irving  Glicksberg 
Oliver  Gross 

§1.  Introduction. 

-The  purpose  of  this  paper  la  present* some  results  of  an 
investigation  of  a  class  of  interesting  and  important  variational 
problems  Involving  the  control  of  a  physical  system  over  a  time 
interval.  One  large  category  of  problems  of  this  nature  arises 
In  connection  with  the  maintenance  of  a  dynamic  system  In  or  near  a 
specified  state  at  minimum  cost..  The  cost  Is  usually  compounded  of 
two  parts,  the  first  part  measured  In  terms  of  the  deviation  of  the 
system  from  the  desired  state,  and  the  second  part  measured  by  the 
cost  of  the  resources  used  for  control.  The  theory  of  mechanical, 
electrical,  and  economic  systems  contain  many  questions  of  this 
type. 

Another  large  category  of  problems,  of  economic  and  Industrial 
origin,  are  those  in  which  It  Is  required  to  maximize  the  output  of 
a  system  given  a  limited  quantity  of  resources.  Only  one  represen¬ 
tative  of  this  category  will  be  discussed  In  this  paper.  - 

The  mathematical  difficulties  encountered  in  treating  prob¬ 
lems  of  the  types  above  depend  to  a  large  degree  upon  the  mathema¬ 
tical  model  used  to  represent  the  system,  the  functionals  employed 
to  measure  the  cost  of  deviation  and  the  cost  of  resources,  and  the 
constraints  Imposed  upon  the  permissible  types  of  control. 


I 
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As  far  as  the  mathematical  modela  are  concerned,  we  shall 
consider  here  physical  systems  which  are  ruled  by  a  system  of 
linear  differential  equations  of  the  form 


(1) 


dx, 


N 


ITT 


58uxj  +  fi(t) 


!■! ,2 ,  • • • ,N 


x.  (0) 


0  <  t  £  T 


which  in  the  more  convenient  vector-matrix  notation  takes  the  form 


(2) 


dx 


-  Ax  +  f(t),  x(0)  -  c,  0  <  t  £  T 


where 


b) 


X  - 


/*■ 
*« 

\*N 


f(t)  - 


f.(t) 

f*(t) 


fN(t), 


/c‘ 

c* 

\°; 


Here  the  vector  x  represents  the  state  of  the  system  at  any  time  t, 
and  the  forcing  term  f(t)  represents  the  influence  of  the  resources 
used  for  control. 

If,  in  place  of  continuous  control,  we  apply  intermittent 
control,  the  equation  above  ia  replaced  by  a  difference  equation, 


(4)  x  ( t+1  )  -  Ax  ( t )  +  f(t),  t-0,1  ,T, 

x(0)  »  c . 
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11*  we  consider  systems  in  which  time  lags  occur,  in  place 
of  (2)  at  (4)  we  obtain  equations  of  the  four. 

(5)  -  Ax( t )  ♦  Bx(t-l)  +  f(t),  1  <  t  £  T 

dt 

x  -  Mt),  0  <  t  <  !  . 


A  discussion  of  control  problems  involving  differential-difference 

equations  will  ne  postponed  to  a  subsequent  paper  because  of  the 

variety  of  new  features  which  arise. 

As  far  as  the  functionals  representing  the  cost  are  concerned, 

we  shall  take  them  to  be  linear  or  quadratic,  with  constraints  of 

linear  form  involving  boundedness  and  positivity. 

We  discuss  first,  in  §2,  the  case  where  the  cost  of  deviation 

is  measured  by  J  Qx— y,  x— yj  dt,  where  j~u,vj  represents  the  inner 

product  of  two  vectors,  where  x  is  the  actual  state,  y  the  desired 

T 

state,  and  the  cost  of  control  is  measured  vy  a  ^Q^fjdt.  The 
problem  is  then  that  of  choosing  an  f  so  as  to  minimize  the  total 
cost 


(6) 


r  t 

J(f)  =  j!  x-y,  x-y]  dt  +  a 
A  i-  J 


where  x  depends  upon  f  uy  way  of  (2).  Using  the  known  representa¬ 
tion  theorems  expressing  the  solutions  of  inhomogeneous  linear  dif¬ 
ferential  equations  in  termE  of  the  solutions  of  the  homogeneous 
equations  and  the  forcing  terms,  the  problem  may  be  reduced  to 


minimizing  the  functional 


(7) 


T  t 

s  r  S 

0  o 


/  K(t,t|  )f ( ti  ) d t i  — y~jd 1 1 


over  all  f. 

A  completely  analogous  problem  is  obtained  for  difference 
equations  in  which  integrals  are  replaced  by  3umB.  For  the  case 
of  d  1  fferential-d 1 fference  equations  a  functional  corresponding 

t '»  ( 7 )  is  obtained  . 

To  treat  t.nese  various  problems  simultaneously  we  abstract  the 
general  problem  and  consider  the  problem  of  minimizing 

(8)  ! | A  f +  g! |2  4  a  j  | f | |2 

where  A  is  a  bounded  linear  operator  on  functions  belonging  to 

T 

L?(0,T\  and  M  f  |  | 2  =  S  fr.flit  -  (f,f). 

o  u  u 

Relate!  t^  bne  problem  of  minimizing  the  total  cost  is  that 
of  minimizing  the  cost  cf  deviation  subject  tc  the  restriction  that 
the  cost  of  control  be  bounded  by  a  fixed  quantity,  and  the  dual 
problem  of  minimizing  the  cost  of  control  given  that  the  CQBt  of 
deviation  is  to  remain  below  a  certain  bound. 

After  having  ootained  the  existence  and  uniqueness  of  the 
minimizing  function  in  the  general  case,  together  with  the  integral 
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equation  It  satisfies,  we  turn  to  the  application  of  the  general 
result  to  the  differential  equation  model. 

In  the  next  three  section!  we  consider  some  particular 
problems  in  which  the  cost  functions  are  of  a  varied  type  and 
in  which  there  are  constraints  on  the  forcing  term  f.  In  §3 


we  treat  the  problem  of  minimizing  (l-u)2dt  over  all  f 

o 

subject  to 


(a)  0  <  f  <  m, 


(b)  f  fdt  <  an 
o 


where  u  is  related  to  f  by  means  of  the  equation 


(10) 


-  -u  +  f,  u(0)«l. 


In  the  succeeding  section,  ^4,  we  treat  the  problem  of  minimizing 
T  J 

^  (du/dt)2dt  subject  to  the  same  constraints. 

In  §5  we  treat  the  problem  of  minimizing  Max  | 1 — u |  subject 

0<t<T 

T 

to  J'  f2dt  <  aj ,  by  considering  the  solution  of  the  dual  problem 
o 

T 

of  minimizing  ^  f2dt  subject  to-d£l-u<d  for  0  <  t  <  T. 

Turning  from  this  class  of  problems  we  consider  a  problem 
arising  in  the  mathematical  theory  of  economics  concerning  maxi¬ 
mization  of  profit.  Setting 


(ID 


dx 

-3F-  “  aljyj<  xl(0)  "  C1 
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where  a^j  >  0,  tne  problem  Is  that  of  choosing  between  0  and 

Xj  bd  as  to  maximize  the  functional 


(12) 


S  |_S 


dt. 


In  the  course  of  the  solution  it  is  necessary  to  answer  the 
following  question,  of  some  independent  interest.  Given 


03) 


*i(0)  -  c1 


what  are  the  necessary  and  sufficient  conditions  upon  the  *»atrix 
A  »  (a^j)  in  or(^r  that  x^  >  C  for  t  >  0  whenever  ^  0  and 
f^t)  >  0? 

The  ar.3wer  turns  out  tc  ie  quite  simple,  namely  a^  >  0,  1  +  J* 
There  are  a  multitude  of  interesting  questions  which  we  have 
not  mentioned  at  all.  A  quite  important  one  ir.  that  where  there 
are  two  forcing  terms, 


(U)  ”  Ax  +  f  ♦  g 


the  first,  f,  representing  factors  at  our  control,  and  th*;  second, 
g,  representing  exogenous  factors  beyond  our  control.  Although  we 
shall  not  discuss  any  problems  of  this  type  in  this  paper,  let  us 
merely  point  out  that  there  are  at  least  two  approaches  to  the  cor— 
respordlr^  minimization  problems.  We  may  regard  g  as  a  random 
function  with  known  expected  value  and  autocorrelation  function, 
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and  minimize  E(j(f,g)).  Or  we  may  introduce  the  concepts  of  game 
g 

theory  and  consider  the  problem  of  determining  the  f  and  g  which 
yield 


(15) 


Min  Max  J(f,g),  Max  Min  J(f,g), 
f  g  g  f 


and  then  consider  the  corresponding  game  over  function  space. 

Finally  we  mention  that  there  are  several  alternative  approaches 
to  the  problems  we  discuss.  If  we  allow  the  problem  to  remain  in 
its  native  form  (6),  subject  to  differential  Bide  condition,  we 
have  the  classical  problem  of  Bolxa.  It  seems,  however,  simpler  to 
consider  the  space  of  functions  ftL8(0,T)  than  the  space  of  func¬ 
tions  possessing  derivatives. 

In  this  connection  we  can  also  use  the  Lagrange  multiplier 
approach,  particularly  in  the  problems  of  the  later  sections.  We 
have  preferred  to  use  a  direct  attack  based  upon  the  Neyman-Pearson 
Lemma.  Subsequently  we  will  present  a  new  approach  to  a  more 
extensive  class  of  problems  based  upon  dynamic  programming  techniques. 


Quadratic  Functional. 

In  this  section  let  us  consider  the  problem  of  minimizing 


(1)  Ja(f)  -  (g  +  Af,  g  +  Af)  +  a(f,f),  a  >  0, 

where  f  and  g  belong  to  L2(0,T)  and  A  is  a  bounded  linear  operator 
on  L*(0,T).  The  function  J_(f)  represents,  from  the  above 

models,  the  total  cost  of  control,  where  the  first  term  represents 
the  cost  of  deviation  and  the  second  term  the  cost  of  control. 
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Theorem  1.  There  Is  a  unique  f€  L2(0,T)  which  furnishes  the  mini¬ 
mum  to  Ja(f). 

Proof i  Since  /6ft( f )  may  be  Interpreted  as  the  norm  of  the  element 
[g  +  Aft  f]  of  L2  x  L2,  the  existence  and  uniqueness  of  the  mini¬ 
mizing  f,  which  we  shall  call  f  ,  Is  a  simple  consequence  of  the 
fact  that  a  strongly  closed  convex  set  in  Hilbert  space  has  a  unlqu 
element  of  minimal  norm.  It  Is  clearly  sufficient  to  consider 
those  f  for  which  a(f,f)  <  l^f  Jft(f).  These  form  a  weakly  compact 
convex  set.  Since  A  is  weakly  continuous,  the  image  of  this  set 
In  Ls  x  L2  is  weakly  closed,  hence  strongly  closed,  and  convex. 

Theorem  2.  Let 


(2)  R_a  -  (-a  -  A*A)_1 

be  the  resolvent  operator  of  the  positive  operator  A#A  (where  A* 
ls,  as  usual,  the  adjoint  operator  to  A ) ,  then 

(3)  fa  -  %  A *g. 

Proof:  Let  A  be  an  arbitrary  real  constant,  f  an  arbitrary  func¬ 
tion  in  L2 (0,T)  and  consider 

(*)  J(fa  +  M  -  (g  +  Afa  +  AAf,  g  +  Afa  4  /\Af )  +  a(fa  +  Af ,  fft  +  Af) 

-  Ja(ra)  +  2^C(g  +  Afa,  Af)  +  a(fa,fQ 
+  7f  C(Af,Af)  +  a(f,f)  ]  . 
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The  condition  that  j(f  +  Af)  be  a  minimum  at  A"  0  yields 

A 

(5)  0  -  (g+Afa,  Af)  +  a(fa,f) 

-  (A*g  +  A'A fa  +  afa,f), 

for  all  f,  which  implies 

(6)  A *g  +  A*Afa  +  afft  -  0, 

which  in  turn  yields  ( 3 ) »  since  —  a  <  0  Is  In  the  resolvent  set 
of  the  positive  operator  A#A. 

Now,  as  is  well  known,  R^Ib  an  analytic  function  In  the 
resolvent  set,  ^  ^  R  ^  *  —  R^,  ^ ^  R^  *  —  2R^,  and 

R  «  —  *(l  +^_1A*A)~~1  tends  uniformly  to  zero  as  A  - >  oo  .  Thus 

(R^A*g,  A *g )  -  ;  ,faj  ,2  - >0  as  a  -  — >  oo ,  and  i f&  \2  is  non— 

increasing  as  a  function  of  a  >  0,  for 

(7)  !|ra  2  -  sl-f'Ta  A-g)  -  2(1*!,  A'«.  A-g) 

-  2<RVa>  fa>  <  0 

since  R  ,  as  the  Inverse  of  a  strictly  negati.e  operator,  is 

Cl 

strictly  negative;  Indeed  since  f  =  0  only  If  A‘g  »  0,  ‘if  j,2  1b 

fl  B. 

strictly  decreasing  if  A *g  ^  0.  Similarly,  since 
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(12)  (g  +  Afft,  g  +  Afa)  -  (g  +  Afft,  g)  -►  (A*g  *  A*Afa,  fa) 

«=  (g,g)  +  (fa»  A *g )  -  a(fa,  fa). 

-  (g,g)  ♦  (H^A^g,  A*g)  -  a(ffl,  fa)» 

we  have 

_  - 

(13)  — I  lg  +  Afal  I  “  "THf  (^_aA*g,  A*g)  —  a(^lftA*g,  A+g) 

°  (Rf^A*g,  A*g)  -  (R^A*g,  A*g) 

-  2a(R^A»g,  A*g ) 

-  -  2a  (R  f  ,  f  )  >  0. 

—a  a  a  ~ 

» 

Thus  1  ig  +  Af  I  j2,  as  a  fnnc 1 1  on  of  a  >  ) ,  Is  non-decreasing,  and 

cl 

strictly  Increasing  If  A *g  f  0. 

These  properties  enable  us  to  easily  dispense  with  the  related 
problems  of  minimizing  the  cost  of  deviation  with  a  limited  amount 
of  control,  that  Is,  obtaining 

(10)  4>(c)  -  rnln  I  |g  +  Af ;  !2, 

! ifl i2<c 

The  nonotone  character  of  \  '  f  j  2  and  I  g  4-  Af  |  j2  can  also  be 

&  O. 

seen  for  A *g  f  0  from  the  fact  that  f„  ^  f.  ,  0  <  a  <  b.  For  If 

a  b 

’->a  -  jig  +  Afa  I  1 2  ,  va  -  j  |  f&  1  | 2  ,  then  +  avft  <  ufe  +  avfe  and 

ub  +  bvb  <  ua  +  bva  80  that  ub  +  bvb  <  ua  +  ava  *  (b-*)va  <  ub 
+  avt  +  (b-a)v&  and  (b-a)vb  <  (b-a)vft  or  vfe  <  v  ;  adding  -  avft  < 

-  avv  to  uo  +  avn  <  uK  +  av.  we  obta'n  u  <  u,  . 

0  a  a  d  d  a  b 
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and  the  dual  problem  of  obtaining 

(n)  y(c)  -  min  I !  r|  I2, 

I  I  g+Af  |  |z<c 

which  1 s  the  minimum  cost  of  control  required  to  keep  the  cost 
of  deviation  below  a  certain  level. 

Let  us  consider  first  the  trivial  case  where  A*g  ■  0  -  f 

a 

(for  a  >  0).  Since  ( f  a )  *=  I  |gj  ,2  £  Ja(f)  -  i  g+Af|  i2  +  a  '  f  2 
for  any  f  and  all  a  >  0,  i !gi i2  ^  i ig+Afj  ;2  for  all  f  and  clearly 
Me )  -  I  I  g ,  ! 2  for  all  c  >0.  ’Moreover  we  have  Y<  c )  -  0  for 
c  2.  I |g||2»  with  y(c;  undefined  for  c  <  gj  j2.  In  the  somewhat 
less  trivial  case  of  A*g  4*  0,  since  |  |f  |  2  is  continuous  and 

cl 

strictly  decreasing,  for  c  In  the  range  0  <  c  <  sup  j  ,  f  2 

8 

«  llm  j  1 |  1 2 ,  we  clearly  have  a  unique  a  >  0  for  which  ,  | f a |  , 2  - 
and  thus  f  alone  provides  6(c),  since  otherwise  we  should  have 

a 

an  f  +  f  for  which  j  g+A f  i  2  <  g4A f_ '  \ 2 ,  : f  >  i 2  <  i  | 1  2  so 

that  JR(f)  <)  Jfl(fa',  wtilch  Is  impossible.  Thus,  to  complete  our 

discussion  of  ( 1 T }  ,  we  need  only  consider  the  case  in  wric.u 
sup  I  f  |  1 2  is  finite,  and  c  >  sup  f  '  i 2 . 

Tf  sup  ! f _  j 2  =  llm  , f  I  2  is  finite,  then  tnere  is  an 

a  a _ >  0  a 

elemer.t  f  to  which  f  converges  strongly  as  a  — >  J,  which  mini  — 

^  <1 

mizes  g+Af  2  for  all  f  In  L2  ,  fierce  provides  0(c)  for  all 

c  £  SUP  ||fall2-  This  follows  from  the  fact  that  the  set  n  | 
has  a  weak  cluster  point  fQ  for  which  ||f0||*  £  lim  |jfal|2, 

and  the  minimal  property  of  ,g  +  Af  j  .  For  since  g  +  Af  is  a 

cluster  point  if  M  Af.,  we  have  j  |  g  +  Af  |  <  llm  g  +  Af  i 

a — >  > 

<  |g  +  Af  .  Hence,  if  ,  'g  +  Af  <  'g  +  Af 

—  3  j 


We  have 
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J  (f)  <  J  (f  )  for  sufficiently  small  a,  contradicting  the  minimal 

property.  Thus,  |  |g  +  Af0|  I  ^  I  18  4  Afj  for  all  f.  Furthermore, 

jjg  +  A  P  |  1  -  ||g  +  A  f  0 1  |  If  and  only  If  Af  -  AfQ,  from  the  strict 

convexity  of  the  unit  sphere  In  L2 .  h'ow  if  Af  ■  Afo  and  therefore 

j  |  g  +  A f  |  |  <;  i  1  g  +  Af  |  I  for  all  a ,  we  must  have  !  f  I  I  >  >  ra  i  1  for 

all  a  so  that  1  f 1  >  11m  !  ‘ '  I  >  •  1 •  I  **a  1  * 

a — >  0  a  ~  a >0 

'T’hus ,  f  Is  the  unique  element  of  minimal  norm  In  the  closed 

o 

variety  jl':  Af  -  Af^. 

Since  this  Is  true  for  any  weak  cluster  point  fQ,  there  Is 

only  one  and  since  ,  i f a i  i  - >  1  i fQ '  :  »  !  1 —  1  I  — ^  ^  as  asserted . 

Also,  since  A*g  +  A  *A  f  =  -  af_  tends  strongly  to  zero,  we  obtain 

9  A  a 

A  +  A  *  A  f  G  -  0. 

Similar  considerations  apply  to  1 1 1  when  A *g  t  1-  For  c  In 
the  range  of  !g+Af  2,  <  a  <  x,  ,  we  have  a  unique  a  for  which 

n 

|g+Af  |  j2  -  c  and  f  alone  provides  t|/(c).  If  c  Is  not  In  this 

A 

range,  we  have  two  cases.  If  c  <  j  |g+Af^| |2  for  all  a  >  )  and 
1  jf  ||2  Is  unbounded,  the  problem  is  vacuous,  since  ||g+Af|!2  <c 
<  I |g+Afa! !2  implies  Ja(f'  <  Ja(ra)  for  I ! f a I , 2  >  l|fll2-  But  If 
aup  i  f  1 | 2  <  av  then  since  the  element  fQ  provides  the  absolute 
minimum  of  |  g+Af  2,  V^(cl  Is  defined  only  If  c  -  I  I  g+A  fQ ,  j 2 , 
and  men  y<=;  -  On  the  other  hand,  if  c  >  jjg+Afal |2  for 

all  a  >  1,  then  since  fftj  i2  — 0  as  a  — >  00  ,  c  >  g!  2 ,  and 

\|j ( c  ;  *  0  is  provided  by  f  ■  0. 
thus 

theorem  3.  If  A*g  f  0,  either  c  -  -  f„ !  2  for  some  a  >  0,  In  which 

—  - -  —  — -  O  ““  — 

case  f  alone  provides  ^(c)  or  c  >  } ■ f  1 ! 2  and  fn  -  11m  fft 

a  a — >  J 

provides  the  minimum .  For  c  In  the  range  of  | | f  1 1 2 , 


p  3c<o 

-,3- 


(12; 


di>(c ) 


& 


■  -  a 


where  c 


f _ | | 2  relates  c  and  a. 

ft  1  .  -  ■  -  -  — 


Similarly,  either  c 


*+AV 


for  some  a  >  0,  In  which 


case  f&  alone  provides  y(c),  or  |fal|2  1b  bounded  and 
c  -  | |g+AfQj  I2,  In  which  case  f0  along  provides  our  minimum 
y(c),  or  c  >  I  jg+Affti  |2  for  all  a  >  0,  ancl  f  «  0  provides  the 
minimum.  Also,  In  the  range  of  ||g+Afa||2, 


(13) 


^(ci 

dc 


! ig+Afa: i2. 


It  only  remains  to  verify  (12)  and  (13)-  Since  — 


d 

“Ta 


g+Afa|'- 


da 


-?a(RH|fa,fal-3f-  and  c  -  ( f  f( 


(Rf*  A  *  g , A  *  g  ) , 


(14) 


*  2<r!a  4*~  ■  2<,(V.'V  -nr 


and  (12)  holds, 
and 


Imilarly,  for  c  »  g+Af, 


=  -  2a ( i<  a,i'  ,f 


da 


-a'  a7  a  ic 


(in) 


a 

Tc" 


a 


. 2  =  2(V  f,f 
v  -a  a '  a 


da 

dr" 


and  ( ! :  holds. 

Let  us  finally  observe  ’  hat.  If  for  some  elerne  .t  h£L*(o,. 
have  g  *  -Ah,  then  tne  value  if  J  ( f  Is  given  oy 

ol  cl 


WP 


P-3  BO 
-K- 


(16)  Ja(f)  -  (g  +  A£,  g  +  A  4)  +  a(^iy 

-  (g  +  A^,  g)  ♦  (g  ♦  A  4,  A 4)  4  a(^4) 

-  (g  ♦  A£,  g). 


by  virtue  of  (5).  Using  g  -  -Ah  and  (5)  again,  we  obtain 
( 17 )  Ja(fa)  -  a(fa,  h) 


§3.  Application  to  Differential  Equations. 

Let  us  consider  the  application  of  the  preceding  results  to 
the  case  where  the  system  under  control  Is  ruled  by  a  set  of  dif¬ 
ferential  equations  of  the  form 


(1) 


dx 
~3T" 


N 


~  ^  buxj + 


xt(0)  -  Cj,  1-1, 2, 


or  by  an  n-th  order  equation 
dNu  dN-\, 

(2)  — u —  *  »i  '  W-l  +  ■"  +  aNu  "  f't>< 

dt  d  t 


k-0,1 ,2,  * 


u(k)(0)  -  c 


,N-1. 
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In  the  latter  case  we  consider  the  problem  of  minimising 


T  r-  N— 1 

<”  S'-' 


A* 

d  u 


-  ck} 


1  T 
8  dt  ♦  a  J  f*dt, 
o 


while  In  the  former  we  wish  to  minimize 


T  i-  N 


<*>  J(f>  -  /  ^  Vv-V* 


t  +  a 


s :  z 

o  k«f 


I  U 


Since  every  N-th  order  linear  equation  may  be  converted  Into  en 
N— th  order  linear  system  by  means  of  the  substitution 


Xi  -  u 


d^u 


we  shall  confine  our  attention  to  systems.  These  are  most  effec¬ 
tively  discussed  using  vector  matrix  technique.  Set 


r(t)  - 


fa(t)  \, 


fN(t) 


e  -  cm  . 


B  -  (»!,).  1, J-1,2, • ' ' ,N 
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Equation  (l)  may  now  be  written 

(7)  .  Bx  +  r(t) ,  x(o)  -  c. 


Let  us  assume  for  simplicity  that  the  coefficients  in  (4)  are  all 
unity,  and  use  the  usual  inner  product  notation 

N 

(8)  [x,y]  -  x1y1. 


The  expression  to  be  minimized  takes  the  form 


(9)  J( 


T  T 

f)'/  [x— c  ,  x-c]  d  t  +  a  /  D'.C'H- 


Furthermore,  we  define  the  norm  as 

1/2  }  1/2 

do;  i  in  i  -  (r,r)  «  (  J  Q-.Qdt; 

0 

To  convert  this  problem  into  the  type  discussed 
in  §  2  ,  we  require  the  following  well-known  result  in  the  theory 
of  linear  differential  equations. 

Lemma  1 .  The  solution  of  ( 7 '  may  be  written  In  the  form 

t 

(11)  X  -  y  +  f  Y(t-t,)f(t,)dt,, 

0 


where  y  la  the  solution  of  the  homogeneous  equation 


(12) 


dy 

3T- 


By,  y (0)  -  c, 
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and  Y  le  the  matrix  solution  of 

(13)  j£-  -  BY,  Y(O)  -  I, 

whloh  1»  to  »ay  Y  -  eBt,  y  •  e^e. 
T  f  we  set 

(14)  g  -  y  -  c 

t 

Aft-  /  Y(t-t, )f(t,)dt,  , 


then  x  •  g  +  Af,  and  the  variational  problem  io  now  a  Bpeclal  case 
of  that  considered  previously. 

Furthermore,  since  y  satisfies  (12),  we  have 

(15)  jf-  -  Bg  +  Bo,  g(0)  -  0, 

whence 

t 

(16)  g(t)  -  J  Y ( t— 1 1  ) Be  dti  -  ABc(t). 

o 

The  aljolnt  operator  to  A,  A#,  is  defined  by 
T 

(17)  A*f  -  /  Y( t-ti ) f ( tt )dt ,  . 

t 
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We  obtain  this  by  considering 


(18) 


(Af,g)  -  f  (If.gdt! 


T  r-  t 


-  J  f  Y(t-ti)f(ti)dti.g(t) 


o  l  o 
T  r 


dt. 


J  J  Y(t-t, )'g(t)dt 


dti  , 


as  we  see  by  Interchanging  the  orders  of  Integration,  where  Y(t— tj ) 
Is  the  transpose  of  Y(t-ti) ,  the  matrix  eB  where  B'  Is 

the  transpose  of  B. 

Referring  to  the  previous  section,  the  minimizing  f  Is  given 

by 


(19)  f  -  )  -a  —  A*A)  1  A *g , 


which  means  that  f  satisfies  the  Integral  equation, 

(20)  af  +  A *Af  -  A *g . 

From  (17)  and  (20)  we  obtain  the  condition 

(21)  f(T)  -  0. 

Since  the  Inverse  of  A*  is  -  B*  ,  we  obtain  from  (20) 

( 22 )  a  (  —  B*f)  4  Af  ■»  —  g, 
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whlch  means  that 


(23) 


df 

TTT 


-  B‘f  -  0  at  t  -  0. 


Using  the  operator  d  -  B  we  have 


(24) 


a(  -  B' )  (  -  B) f  +  f 


“*3T 


"(~ar  -  D^*  “Bc- 


This  Is  a  system  of  linear  differential  equations  subject  to 
the  two-point  boundary  conditions  of  (21)  and  (23)*  The  solution 
exists  and  Is  unique  by  virtue  of  Theorem  1 . 

§4 .  Application  to  Difference  Equations. 

Similar  results  hold  for  the  variational  problem  associated 
with  the  system  of  difference  equations 

(1)  x ( t+1 )  -  Ax( t )  +  f(t),  t-0,1 ,2,* *  * ,T 

x(0)  -  c. 


with  the  norm  defined  by 

T 


(2) 


f||  -  (  l?U).  r(tO) 


1 

7 


The  analogue  of  Lemma  1  is 

Lemma  2.  The  solution  of  (1)  may  be  written 


x(t)  -  y(t)  + 


•0 


(?) 


Y(t-t,-l)f(t, ), 
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where 


y( t*fi )  -  By ( t ) ,  y ( o )  -  e, 

Y(t+1 )  -  BY ( t ) ,  Y(O)  -  I, 


which  la  to  say  Y  -  Bfc,  y  -  Bt  c. 

The  remaining  details  are  now  completely  analogous. 

55*  Differential-difference  Equations. 

If  we  consider  problems  of  continuous  control  with  a  time  lag 
we  meet  functional  equations  of  the  form 


-  au(t)  +  bu(t— 1)  +  f(t),  t  >  1 


u(t)  -  g(t),  0  <  t  £  1 


Although  results  similar  to  the  above  hold,  we  shall  postpone  dis¬ 
cussion  of  these  until  a  later  paper  devoted  solely  to  equations 
of  this  type,  since  some  additional  difficulties  arise. 


^§6.  A  Result  Concerning  Positivity. 

Let  us  agree  to  call  a  vector  x  non-negative  if  all  of  Its 
components  are  non-negative  and  write  x  0,  and  similarly  call  a 
matrix  A  non-negative  if  a^j  £  0,  writing  again  A  ^  0. 

Using  this  notation  we  shall  prove 

Theorem  4.  The  necessary  and  sufficient  condition  that  the  solu¬ 


tion  of 


P-580 
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(l)  ♦  f(t),  x(0)  •  C, 

b#  nan-negative  for  t  >  0  whenever  f(t)  and  c  are  non-negative 
Is  that 


(2)  atJ  >0,  1+J. 

Proof i  Ths  solution  of  (l)  has  the  forn 


>• 


(3) 


x  ■ 


eAt  c 


froB  which  It  follows  that  If  x  ^  0  for  all  c  £  0  and  f(t)  £  0, 

At 

we  must  have  e  £  0,  and  clearly  this  Is  sufficient. 

The  problem  then  reduces  to  finding  the  necessary  and  suf¬ 
ficient  condition  that  eAt  £  0  for  t  £  0.  Since  «  I  +  At 
+  *  *  * ,  it  is  clear  that  a^j  £  0,  1  ^  J  is  necessary  in  order  that 

eA^  0  for  a®all  positive  t.  The  following  simple  proof  that  this 

f 

condition  Is  sufficient  is  due  to  S.  Karlin.  We  have  eAt  -  (eAt^n)n 
for  any  Integer  n.  ChoOslng  n  large  enough,  we  will  have  eAt^n  >  0 
for  0  £  t£tf,  by  virtue  of  a^  £  0.  Since  the  product  of  non¬ 
negative  matrices  is  non-negative,  we  obtain  the  desired  result. 

In  the  case  of  variable  A(t)  sufficiency  at  least  may  he 
established  readily  by  means  of  the  change  of  variable 


1«1 ,2, *  * • , N, 


converts  (l)  Into  the  form 


(5) 


dyl 

“3T“ 


auyj +  fi<t)e 


-S  »u(t)dt. 


y1(o)  «  c ^ 


The  sufficiency  of  the  condition  £  0,  i  f  J,  Is  now  clear.  J* 


57,  A  Problem  In  Mathematical  Economics. 

Let  us  consider  the  following  Idealized  problem  In  mathema¬ 
tical  economics.  We  have  a  system  with  N  outputs  measured  by  the 
variables  x^t),  1-1,2, •••N.  Each  output  x^  la  divided  Into  two 

parts  y^  and  z^  where  z^  Is  tak*n  out  as  profit  and  is  reinvested 
co  Increase  future  output.  Assuming  that  the  change  In  output  is 
determined  by  the  equations 


dx. (t) 
(i)  — - — 

dt 


N 


£ 


Vj(t|- 


!■!  ,2 ,  *  *  *  ,N , 


x^(o)  —  c  ^ , 
with  a^  £  0, 


what  reinvestment  policy  does  one  follow  in  order  to  maximize  the 

N 


total  profit, 


? 


/  £ 


(x.-y, )  4t  ? 
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Since  it  is  not  difficult  to  eatablish  the  existence  of  a 
aolutlon,  we  shall  omit  this  point  and  turn  immediately  to  obtain¬ 
ing  the  solution. 

In  order  to  illustrate  clearly  the  techniques  Involved,  we 
shall  treat  in  succession,  the  one-dimensional,  two-dimensional, 
and  N-d Imens ional  problem. 

The  One -dimensional  Problem. 

We  have 

(2)  -jf1-  -  *i»yi»  »ii  >  0,  x,(0)  -  c, 


and  we  wish  to  maximize 


(3) 


i  u 

Jt  -  /  (Cl  +  an  f  yidti  -  yi)dt, 


where  yi  is  subject  to  the  conditions 


(5)  0  1  7i  £  Ci  +  a, i  J  yidt. 


An  Interchange  in  the  order  of  Integration  in  ( ^ )  yields 


(6) 


A 

Ji  •  CiT  4*  (aii(  T— t )  — 1 )  y  i  d  1 1 . 


Let  Ti  be  the  value  of  t  for  which 


(7) 


an  (T-t)  -1  -  0, 
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assuming  for  the  moment  that  T  >  l/in •  The  function  y»  which 
maximizes  (6)  subject  to  (5)  la  then  given  by 

t 

(8)  y»  -  c,  ♦  an  S  0  £  t  £  Ti, 

o 

-  0  ,  Ti  £  t  £  T 

Note  that  Ti  depends  upon  T.  If  T  £  l/att»  y»»0  ia  the  maximizing 
funotlon.  There  Is  no  difficulty  In  obtaining  the  explicit  form 
of  yt. 

The  Two-dimensional  Problem. 

Consider  the  problem  of  maximizing 

T 

(9)  "  J  (zi+z*)dt, 
where 

f 

(]0)  "  *uh  +  ai2y2- 

“  c ^ p 

au  -  °»  and*  flnally»  zi  ■  xi  -  yi»  0 1  l  xi' 

Solving  for  the  x^  in  terms  of  the  in  (10)  we  obtain 

t  t 

do  xi  "  ci +  ait  /  yidt  +  ai2  /  y2dt< 
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The  expression  for  J*  then  takes  the  form 


T 

- 

t 

a 

t 

r 

—4 

(12) 

Ja  -  J 

Cl  4-  an 

J  yi^t 

4  Bat 

J  yi^t 

-  yi 

dt 

0 

— 

0 

0 

T 

t 

* 1 

t 

A 

-1 

-  f 

Ca  4*  aja 

J  y*dt 

4  a aa 

J  ya^t 

-  ya 

dt 

<y 

_ 

0 

0 

T 

-  (ci+orjT  +  J  ((1,1+aai )  (T-t)-l)  ytdt 

o'  ' 

T 

4-  J*  ^(aia+asi )  (T—t )— 1^  y»dt. 

o  x  ' 

Let  Tx  ,  Ta  be  given  by 

(13)  Uii+*ii)(T-T|)-l  -  0, 

(•«ia+*aa  )  (T— Ta  )  — 1  “  0, 

and  take  T  large  enough  bo  that  T»  and  Ta  are  positive.  Assume 
without  lose  of  generality  further  that  T2  >  T». 

A  partial  solution  to  our  maximization  problem  Is  then  given 

by 


yi  -  y2 

-  0, 

Ta  1  t  £  T 

Z| 

-  o, 

0  £  t  <  Ta , 

Zi 

*  0, 

0  <  t  £  Tt. 
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The  only  unknown  remaining  Is  the  value  of  z4  In  T»  <  t  <  T2. 
Returning  to  the  expression  for  J2  In  (9)  and  using  the  partial 
results  of  (l4)  we  obtain 


(15) 


Xf 

J2  «  J  Z,dt,  4-  (T-T2)  (x,(T2)  ♦  x2(T*))  . 


Employing  (9)  we  obtain 


(16)  Xi(T2)  *»  Ci  +  a, ,  y>dt  4-  ai2  ^  yadt 

o  o 

*  c3  +  at  1  ^  .yadt  4-  ata  ^ 


x2dt , 


where  c3  Is  a  constant  Independent  of  the  value  of  y2  In  n’t  ,T^]  , 
and  similarly 

t2  t2 

(17)  x2(T2)  ■  C4  +  an  yidt  -f  a22  ^  x2dt. 

T,  ?! 


Using  Zi  *  Xi  -  y i  *  ci  +  Sii  /  yfdt  4-  ai2  }  y2dt  -  yx , 


we  obtain 


finally 


(18) 


Ta 


T2  t 


Jz  *  4-  J  (•  6(T-t)-l)  yidt  +  a,2Q/  -T  Yadt)  dt 


4-  ( s  1 2  4-  a2 1 )  ^ j  x2dt. 
It 


To  proceed  further,  we  require  an  expression  for  §  y2dt  for 

o 

0  £  t  <  T2.  In  this  Interval  we  have 
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(19) 


d 


(J  yadt^ 


t  t 

y2  ■  c2  ♦  aat  J'  yidt  ♦  a2a  S  y*dt. 


and  thus  solving,  we  obtain 


t  „  t 

r  »2*b  /*  -aaas 

(20)  J  y2dt  -  e  J  e 


cs 


♦  *21  J  '  y»dti  ds 


a2at  A  /  -e2aS  r  v 

ii(t)  +  a2t  e  J  (e  J  y,  ( 1 1  )dt,  )  ds, 

Tj  '  T»  / 


for  T»  <  t  £  Ta,  where  4>t  Is  Independent  of  the  value  of  yt  In 
Hence 

Ta  t2 

(21)  S  x2dt  «  S  yadt 

T»  Tj 

a22T2  -a22s  /?  ^ 

•  ci  +  a2Je  J  (e  J  y» (t| )dt| )da. 


Interchanging  orders  of  Integration,  this  Is 


(22) 


*22-2 


C,  + 


a21  * 


'"P  'P 

f»2  /  r*2  -*28®  \ 

J  f  y» (ti )  J  e  ds  J  dt 

Tj  N  t|  / 


The  Important  point  to  observe  Is  that  the  coefficient  of  yt ,  namely 


a 

■22*2 


a2t  e 


•^2 

/ 


ds.  Is  a  decreasing  function  of  t|. 


T2  t 

It  remains  to  simplify  the  expression  J  (S  yadt')  dt. 

Ti  \  o  / 


We  have 
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(23)  ^  S  dt  •  Cg  ♦  *21  ^  je  **  X  yi(ti)dti^ds 


dt 


-  c3  a21 


P  e  X  ytUt)  (  S  e  dB)  dt»  dt* 

Tl  L  T»  Vt» 


The  integral  has  the  form 


T8 


(24) 


s  •”■“(/  y»(ti) f (t.t»)dt| )  dt 


Ti 


r2  (  r2  ■«*  \ 

-  J  y»(t»)  (  J  e  Vf»(tfti)dt  )  dti . 

Ti  Hi  / 


We  have 


(25) 


T8 


(  J  ea*8t  y(t,t»  )dt^  -  -e  y(t|»t 

Ta 

■>22  ** 

f.  *  ^ 


~3T 


a8ati 

-«  YlHiH 


*  f  •-*  « 


rn 

r2  aaat  /  -a2at|  \ 

-  0  ♦  J  e  ^-e  J  dt»  <  0. 


Hence  the  coefficient  of  yt  in  (24)  is  monotone  decreasing.  Refer¬ 
ring  to  (18)  and  observing  that  Cg(T— t)-l  is  monotone  decreasing, 
since  >  0,  we  see  that  the  total  coefficient  of  j%  will  be 
decreasing  in  (Ti,Ta)  when  J2  is  written  in  the  form 


T2 

S  k(t|)yi  (ti)dte 

Ti 


(26) 


J2  -  Cg  + 


P-380 

-29- 


To  maximize  then,  we  choose  yt  as  large  as  possible  In  (Tt  ,7^ 
where  k  £  0,  and  equal  to  zero  in  Q3,T^  ,  where  k(Ts)  »  0. 

Since  c^(T— t)— 1  is  negative  for  t  >  T|  and  the  other  coef¬ 
ficients  are  zero  at  T2 ,  it  follows  that  T3  is  actually  between 
Tt  ana  T2 . 

We  have  thus  demonstrated  that  the  maximum  of  J2  subject  to  (10) 
et  seq.  is  given  by 

(27)  yt  -  yB  -  0,  Ta  <  t  <  T 

z2  =  0,  0  t  ^  t2 

Zi  -  0,  0  £  t  £  T3, 

where  T3  is  a  definite  number  between  ?2  and  Ta ,  and 


(28)  (att  +  a?t)(T— Tj)— 1  *  0, 
(sta  +  a22 ) (T— T2 )— 1  ■  0, 


for  T  >  l/(8n  ♦  a2t  '  >  l/(at2  4-  aaa ) . 

The  other  cases  admit  of  similar  solutions.  The  conditions 
atl  >  0  may  be  relaxed  to  at|  +  a2i  ^  0,  aJ2  4-  a22  ;>  0. 

The  N-dlmenslonal  Problem. 

If  we  examine  the  details  of  the  previous  case  we  see  that 
everything  hinges  on  the  fact  that  eaazt  is  non-negative.  In  order 
to  see  what  the  required  analogue  is,  let  us  consider  the  N— 
dimensional  case  using  vector-matrix  notation. 

We  have,  as  before 


aij) (T-t)-G  yj  dt» 


(29)  j 
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where  0  <  y^  <  Xj  and  the  satisfy  (l).  Talcing  T  large  enough, 

let  0  <  Ti  <  T2  <  •  •  •  <  Tf-  be  given  by 

N 

(30)  (  aiJ)(T~Tj)-l  «  0. 

As  above,  it  follows  immediately  that  y^  la  given  by 


(31)  yN  -  xN,  0  £  t  £  tn, 
-  0  ,  T„  <  t  <  T. 


We  may  then  eliminate  y^,  and  solve  for  yN—1  In  (Tj,^,  T.j)  the  only 
Interval  In  which  It  Is  unknown. 

At  the  very  next  step,  when  eliminating  y^_j  and  y^  and  expreae— 
lng  them  In  terms  of  the  other  yk  we  are  confronted  by  the  problem 
of  solving  a  system  of  equations  of  the  form 


N  K  t 

—  +  /  yjdt  +  ci*  1’R+1>'','N 


for  the  u1#  1-R+l , *  *  * ,N,  in  terms  of  the  yj,  and  of 

determining  the  monotonocity  properties  of  the  coefficients  of 
the  yj. 

In  order  to  solve  this  problem  we  employ  vector-matrix  nota¬ 
tion.  Let 
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and  consider  the  system 


(34) 


dv 

7TT 


i 


Av  +  b  I  y.  dt,  v(0)  »  0. 


where  all  the  components  In  b  are  non-negative.  The  expression 
for  v  Is 


(35) 


v  ■  e 


At  C  -As  } 

o  b(  J  ykdt)  ds. 


Interchange  of  order  of  Integration  yields 


(36) 


t  t 
1 

O  ti 


-  eAt  /  (  J  e”*8  ds)  b  yk(t,)dt,. 


is.  1  i. 

The  matrix  function  e  f  e  ds  enters  as  one  coefficient. 


The  derivative  with  respect  to  tj  Is  -eA^T-tt'. 

T 

Slallarly,  when  we  consider  £ v  It  we  obtain 

r 

(37)  J  eAt(  X  f(t,t|)b  yk(tt)dt^  dt 


b  yv.(t!  )dti . 


Since 
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(38) 


3TT  J*  eAt^(t,ti)dt 


-  -eAt» 

m 


«=  o  - 


T 

eA(t-tt) 


dt! , 


we  see  that  everything  depends  upon  the  signs  of  the  elements  of 

A  f  e  _ 

e  .  We  have,  however,  in  96,  demonstrated  that  all  the  elements 
will  be  positive  in  eAt  if  a^^  £  0  for  i  ^  J. 

Using  the  above  results  and  the  previous  techniques,  we  may 
establish  that  the  solution  to  the  maximization  problem  has  the 
same  general  form  for  all  dimensions,  namely  , 


(39)  yk  -  *i» 
»  0  , 


0  <  t  £  s,_, 

aV 

sk  <  t  <  T»  k«l,2,* • • ,n. 


The  computation  of  the  numbers  Sk  is  laborious  but  straight¬ 
forward  . 

Let  us  observe,  finally,  that  the  simplicity  of  the  above 
result  is  due  to  the  fact  that  we  assumed  all  the  coefficients 
were  non— negative.  Actually,  all  that  is  required  is  that 
a^j  ^  0,  1  ±  J  and  that 


(*0) 


«J“1  »2,  *  *  ’  ,n. 
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In  the  general  case  where  the  a^j  are  both  positive  and  negative, 
the  problem  will  be  much  more  difficult. 

£8.  Quadratic  and  Linear  junctl opals. 

If  either  the  coat  of  oontrol  or  the  coat  of  deviation  la  taken 
to  be  a  linear  functional,  and  linear  constraints  of  physical  origin 
are  Introduced,  the  complexity  of  the  problem  of  minimizing  the 
total  coat  la  greatly  Increased.  Essentially  this  Is  due  to  the 
fact  that  unrestricted  variations  are  in  general  no  longer  permissible 

The  problem  now  requires  a  combination  of  classical  variational 
techniques  and  Neyman— Pearson— type  techniques  blended  in  an  adroit 
manner. 

Our  first  result  is 


Theorem  5.  Let  x  be  the  absolutely  continuous  solution  on  2L 

T 

n-  •  -  x  +  f,  a.e.,  x(0)  -  1.  Then  the  minimum  of  (l-x)2dt 

T  ° 

subject  to  f  dt  £  a  <  T,  0  £  f  <  M(M>1)  is  furnished  by 
o 


(1) 


t  <  log  (1/1-A) 

log  (1/1  -A  £  t  <  log  (1/1  —A)  ♦  »/l-> 
log  ( 1  /l— Al  +  a/l-a  <  t. 


where  /v  is  determined  by  a  transcendental  equation  given  below. 

T 

The  minimum  of  /  (ax/dt)*dt  under  the  same  conditions  Is  furnished 
o 

by 


r(t) 


t-b)2  ♦  p{ t— b)  t  £  b 


(2) 


0 


K  t  <  T 
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where^/1, /*»  b  are  determined  by  transcendental  equations,  given 
below. 

) 

Proof:  Let  S  denote  the  subset  of  L*(0,T)  of  all  f  for  which 

0<f<M,  f  dt  £  a,  which  Is  weakly  compact.  Since 
o 

8 

(3)  x(t)  -  e_t  ♦  e_t  j*  e8f(s)ds, 

o 


the  mappings  f  — >  1-x,  f  — >  dx/dt  -  -x  ♦  f  are  weakly  continuous 
so  that  the  Images  are  weakly  (hence  strongly)  closed  convex  sets 
and  have  unique  elements  of  minimal  norm.  Since  each  mapping  Is 
easily  seen  to  be  (1—1),  In  each  case  there  is  a  unique  minimizing  f. 

Let  fQ  minimize  J(f)  ■ l-x)2dt,  and  for  f  in  S 
let  fx=  (i-»  fG  ♦  *f,  oao. 

T  t 

(M  $(*)  *  J(fA)  -  S  U-*_t  ~e~t  X  e*[jl-X)f0(8)^W(»)]d»)*dt. 


Since  $(0)  must  be  the  minimum  of  t  on  (T),Q  ,  we  have 

T  t 

(5)  0^'(0)  -2  f(l-x Q)(-e”t  /  e8  (f(s)-fQ(a)ds)dt, 

o  o 

t 

where  xQ  (t)  -  et  ♦  e_t  X  e8fQ(«)dB*  Since  clearly  >  0,  this 

o 

condition  implies  J(fQ)  ■  i(0)  £  ^(1)  *  J(f).  Thus  fQ  Is  the  unique 
element  of  S  for  which 


(6) 


T  r 

r  (l-x^e”*  X  eBf0(s)ds  dt  £  X  (l-x0)e_t  J  eBf(s)da  dt 

v  o  o  o 


for  all  f  in  S.  Interchange  of  the  order  of  Integration  yields 


P— 380 

-35- 


(7) 


T  p  T  ij>  ip 

wf  fo(c)|*  f  e  (l-*0)dt  dB  £  /  f(s)  |eB  £  e”t(l-K0)dtJd8 


so  that  fQ  maximizes  (f,Kc)=|* 


fK  ds ,  over  8 ,  where 
o'  ' 


(8) 


K0(») 


A 

e»  S  o-1  (1-- 


Xn)dt 


(which  of  course  depends  on  fQ),  and  the  determination  of  f  appears 

as  a  problem  of  the  Neyman— Pearson  type. 

Before  we  pursue  f  further,  note  that  for  •<  £  1 ,  f  <  •<,  (a.e) 

Implies  x  £  Ot,  ,  with  strict  Inequality  for  <X  >  1  (in  particular 

x(t)  <  M);  for  etfQ(t)  •  d/dt(etxQ( t) )  <0^*  and  thus  etxQ(t)  -  1 

<0let  —  o(^ocet  -  1.  Also  KQ(t)  ■  on  a  set  Implies,  as  one  sees 

by  differentiation,  that  xQ(t)  »  1  —  0(  -  fQ(t)  (a.e)  on  this  set.* 

With  these  simple  facts  In  mind  we  can  now  deduce  several  facts 

about  Kq  which  will  determine  fQ.  First  E  -  |t:  KQ(t)  >  o}  is  non- 

void;  otherwise,  since  clearly  fQ(t)  «  0  (a.e}  where  KQ(t)  <  0 

and  f(t)»l— 0»1  where  Kc(t)  «  0,  we  should  have  xQ  (t;  £  1 

and  not  identically  t  (since.  If  x  (t)  *  1,  then  f  (t)  «  1  a.e.  and 
T  t  T 

J  fQ  dt  >  a)  so  that  K0(t)  *  e  fe  (l-x0(s))ds  >  0  for  some  t 
o  t 

despite  the  assumption  that  KQ  <  0. 

Secondly,  the  measure  of  the  non-void  set  E  (which  is  open  since 

K  is  continuous)  exceeds  &/M.  For  if  this  is  not  the  case  those  f 
o 

In  S  which  maximize  (f,KQ)  have  f(t)  •  M  for  t*E;  in  particular, 
since  fQ(t)  -  M  on  E,  KQ  is  twice  differentiable  in  E  and 
K^(t)  -  K0(t)  -  ( 1— XQ ( t ) ) ,  K^(t)  -  Kq( t )  +  x^(t)  -  K^(t)  +  M  -  x0(t). 
_____________ 

For*e_t  « /  e“®(l-x0(s)  )ds  and  thus  xQ(t)  -  1  -<*-  e-t 
t  ^ 

♦  e-t  X«8f0(®)d8»  80  (l-«0et  ■  etfQ(t),  a.e. 
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Consequently  KQ  has  no  maximum  on  EO(0,T)  (at  such  a  maximum  t 
K0(t)  ■  0  and  0  £  K^(t)  -  M  -  xQ(t)  >  0).  Thus  KQ  Is  monotonlc 
on  components  of  E,  and,  as  Is  easily  seen.  If  t£E  then  either 
[0,t]  Is  contained  In  E  and  KQ  Is  non— Increasing  there,  or  [t,T] 

Is  contained  In  E  and  KQ  Is  non-decreasing  there.  The  latter  can¬ 
not  be  the  case  since  Kq(T)  ■  0;  neither  can  the  former,  since 
then  0  £  K£(0)  -  Ko(0)  -  (l-xQ(0))  =  KQ(0)  >  0,  and  we  come  to 
the  contradictory  conclusion  that  E  must  be  void,  so  that  the 
measure  of  £t:KQ(t)  >  o|  ,  |  £  t:KQ(t)  >  0^  |  >  aA- 

Since  this  Is  the  case,  there  Is  a  non-void  set  of/4>  0  for 
which  |  ft:KQ(t)  >  aA;  let  ^  be  the  sup  of  these^.  Then 

I  ft:K0(t)  >^CJ!  =  |^[t:K0(t)  >yu}|  >  aA  and  |  [t:KQ(t)  >^  \  <  aA 
since  £t:KQ(t)  >  Is  the  union  of  an  Increasing  sequence  of 
sets  £t:KQ(t)  i  eachof  which  has  measure  <  aA*  In  view 

of  this  last  fact  every  f  In  M  maximising  (f,KQ)  has  value  M  In 
j~t:K0(t)  and  by  exactly  the  argument  used  In  the  previous 
paragraph  we  find  this  set  Is  void. 

Thus,  setting  E  *  j^t:K0(t)  -  sup  X^j  ,  |e|  >  aA  and  any 

f  ir.  M  maximizing  (f,K0)  vanishes  outside  E.  Since  xQ  Is  strictly 
decreasing  where  fc  vanishes  and  assumes  the  value  1  —  %  on  E, 
the  closed  set  E  must  be  an  Interval  [tt,t*],  and  clearly  / 

tj  =  log  since  xQ(t)  *=  e-t,  t  <  t».  Now  It  Is  obvious 

that  any  f  which  assumes  the  value  M  on  a  subset  of  E  of  measure 
aA  and  zero  elsewhere  maximizes  (f,K0),  so  that  the  maximum  Is 
M  ^  a  A  »>s;  ( fQ  ,Kq  )  »^a  «  (l-A)  >  I E  |  ,  |E|  «  a/l->  and  we  see 
that  f  has  the  form  Indicated.  We  obtain  an  equation  for  ^  from 
K(ta)  ■  >,  x(t)  -  (l-^)eta_t  (for  t  i  ta)  which  yields  as  the 
equation  for  %  , 
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(9)  3/2(1-*)  -  1  -  (1-A)-1  e 


-T 


♦  l/2(l-»“3  e 


3a 

TT* 


-T 


T 

The  minimization  of  J(f)  *  J*  (dx/dt)2dt  over  S  can  be 

o 

achieved  in  the  same  manner,  as  we  shall  see.  Let  fQ  minimize 
this  functional  J  and  set  f^»  (l—  A)f0  ♦  *f,  4>(*)  ■  J(f^), 

0  £  *  <  1  or 


i  i 

(10)  *(*)  -  J"  ((l-A)f  (t)+Af(t)-e_t-e-t  /  e8f(l-^)f  (a)-*-Af  (sf]ds)2dt 

o  o  L  J 


for  f68*  One*  again  we  have 


T  T 

(11)  0  <  6'(0)  -  2  /  (f0-x0)(f(t)-f0(t)-e*t  J  e*J~f (s)— fQ(a )"]ds )dt 

o  o  q  ^ 


and  fQ  as  the  unique  element  of  S  for  which 

t 

(12) 


J  (fo-xo^e_t  /  «Sfo(8)d8  -  fo<t))dt  > 


i  T. 

J’(fo-xo)(*‘t  X  e8f (a)da-f (t) )dt 


for  all  f  In  S.  Interchange  of  the  order  of  Integration  yields 


r  r  T 

(13)  J  fQ(s)  !  e8  f  e-' 


(fo-xo)dt 


(f0(8^xo(8)) 


ds  > 


»-  T 


J  f(s)  e8  /  e  t(fQ-xo)dt  -  (f0(a)-xQ(a) ) 


da 


so  that  fQ  maximizes  the  inner  product  (f,KQ)  where  we  aet 
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T 

(14)  K0(a)  -  xQ(s)  -  f0(s)  ♦  es  /  e”*  (f0-xQ)dt 

8 

for  all  a.*  Kq  need  not  be  continuous  In  this  case,  of  course, 
but  KQ  ♦  fQ  1%  and  this  may  be  used  to  provide  the  analogues 
of  the  previous  arguments. 

Suppose  first  that  KQ(t)  £  0  a.e.  Since  fQ  maximizes 
(f,KQ),  fQ(t)  «  0  on  all  but  a  subset  E  of  ft:  KQ(t)  <  O,jlof 
measure  zero.  If  we  decrease  fQ  to  zero  on  E  (so  that  by  (14)  we 
Increase  KQ)  then  for  the  altered  and  clearly  equivalent  fQ  and 
Kq  we  have  fQ(t)  »  0  whenever  KQ(t)  <  0.  Now  for  the  altered  KQ 
we  have  ^t|K0(t)  <  0^  open,  for  otherwise  we  have  tn  — >•  t, 

K0(t)  <  0  and  K0(tn)  -  0  so  that  KQ(t)  ♦  fQ(t)  -  KQ)t)  <  0  *  KQ(tn) 
♦  fG(tn),  which  would  contradict  the  continuity  of  KQ  ♦  fQ  guaran — 
teed  by  (14). 

Since  fQ(t)  »  0  on  this  open  act  KQ  is  continuous  and  dif¬ 
ferentiable  on  It,  and  T 

^(t)  -  x’(t)  ♦  et  £  e"*(f0-x0) ds  -(fQ(t)  -xQ(t)) 

-  Xq ( t )  ♦  K0(t)  -  fQ(t)  -  xQ  %)  ♦  K0(t) 

-  K0(t)  -  xc(t)  <  0. 

Suppose  (ti,t8)  Is  a  component  of  this  set.  Then  t*-T,  for  other¬ 
wise,  since  K0  Is  decreasing  on  (ti,t*),  K0(t8— )  <  0  and  KQ(t8)  • 
K0(ta— )  -  f0(t2)  <  0  so  that  1*  would  be  In  |t:KQ(t)  <  0^.  Thus 
the  set  must  be  an  Interval  (b,TJ  (the  same  argument  shows  T  Is  in 

Prom  this  point  on  we  shall  think  of  f  and  K0  as  specific  func¬ 
tions  and  not  as  equivalence  classes  or  functions  differing 

on  sets  of  measure  zero. 
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the  aet)  although  K0(T)  -  xq(T)  >  0.  Thus  we  cannot  have 
Kq  £  0  a.e. ,  or  |  ft:KQ(t)  >  o'}  |  >0. 

Mow  aa  In  the  first  minimization  we  can  aaaert  that 
|  £t:KQ(t)  >  0}|  >  a/*!.  For  If  this  la  not  the  caae  then  fQ(t)  -  M 
a.e.  on  £t:KQ(t)  >  <0  ,  so  that  In  Increasing  fQ  to  M  on  all  this 
set  we  decrease  KQ  and  obtain  equivalent  f(),  Kc  for  which  fQ(t)  ■  M 
whenever  KQ(t)  >  0.  por  this  new  ft:  KQ(t)  >  oj  la  open; 
otherwlae  we  would  have  tR  — >  t,  KQ(tn)  £  0,  K0(t)  >  0  and  thus 
K0(tn)  ♦  fQ(tn)  £  fQ(tn)  £  M  <  K0(t)  ♦  M  -  K0(t)  ♦  fQ(t),  contra¬ 
dicting  the  continuity  of  KQ  ♦  f0.  Now  KQ  la  differentiable  on 
this  aet  and  K^(t)  -  fQ(t)  -  xQ(t)  ♦  KQ(t)  -  M  -  xQ(t)  ♦  KQ(t)  >  0, 
so  that  Kq  is  strictly  Increasing  on  Its  components.  Consequently 
If  (tt,ta)  Is  a  component,  then  KQ(ta— )  >  0  and  since,  by  continu¬ 
ity.  K0(t«-)  ♦  M  -  K0(t)  ♦  fQ(t),  K0(ta)  -  KQ(t2— )  ♦  M  -  f0(t8)  >  0, 
and  we  must  have  ta  -  T,  and  Indeed  T  In  the  component.  Thus 
Jt:  K0(t)  >  6\  -  (b,f].  But  then  fQ (T )  -  M  and  0  <  KQ(T)  -  xq(T) 

—  M  <  0,  which  la  the  desired  contradiction. 

Aa  In  the  first  minimization  let  A  be  the  supremum  of  all 
/(  >  0  for  which  |{t:  K0(t)  *o  that  |  £t:  KQ(t) 

£  a/to  and  |  J"t:  KQ(t)  >  ^  |  <  a/to.  Aa  before  we  can  modify  fQ, 

KQ  on  a  aet  of  measure  zero  ao  that  fQ(t)  •  M  whenever  KQ(t)  >  X  , 
and  by  exactly  the  argument  of  the  preceding  paragraph  we  find  that 
for  the  modified  KQ,  £t:  KQ(t)  >X.J  Is  void. 

Thus  we  have  an  f  and  KQ  for  which  |  ft:  KQ(t)  j  |  £  a/M 
and  K0(t)  <  X  for  all  t.  For  this  K0  and  fQ  we  have  f Q ( t )  ■  0 
for  all  t  in  ft:  KQ(t)  <  ^outside  a  subset  E  of  measure  zero.  Let 
ta  modify  (fQ,  Kq)  on  E  to  form  the  equivalent  pair  (fQ,  KQ)  in 
the  following  fashion:  set  «  ft:  t  €E,  K0(t)  ♦  f 0 ( t )  £  Xj, 
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E£  »  jt:  t  4  E,  v-c(t)  +  f0(t)  ,  and 

roU)  -  K0(t)  ♦  f0(t),  T0(t)  -  O  for  teEi 

K0(t)  -  ^  ,  ro(t)  -  ro(t)  -  (A-  K0(t) )  >  0  for  t  €E«. 

Than  T,  ♦  1T0  -  fp  +  KQ,  JT.(t)  for  all  t  and  f0(t)  -  0  whenever 
!T0(t)  </u  Omitting  the  bars  we  can  now  assert  that  E  -  £t:  K0(t)  < 
Is  open,  for  otherwise  we  have  tn  — >  t,  Kc(tn)  -  KQ  )t)  <  ^ 
and  KQ(tn)  +  f0(tn)  >  KQ(t)  -  KQ(t)  ♦  fQ(t).  Moreover,  for 
any  boundary  point  of  E  we  have  fp(t)  -  0  since  we  have  tn  — >  t  ^.E, 
tn6E  and  thus  KQ(t)  ->  >  K0(tr), 

Sf'-n'  "  xo<V  +  «  " 

en 

T 

<  K0(t)  «  xQ(t)  -  fQ(t)  ♦  e*  if  e“®  (f0-xQ)ds 
so  that  fQ(t)  <  0. 

Now  suppose  t|,  t2,  ti  <  t2  are  In  the  complement  of  E  and 
(t|,t2)C  E.  Then  since  f Q( t^)  «  0,  Kc  Is  continuous  on  Qt,t£]» 
and  In  (tx,t2). 

K«(t)  -  x'(t)  ♦  K0(t)  -  K0(t)  -  xQ(t) 
so  Kjj(t)  -  K£(t)  -  x£(t)  -  K0(t)  -  x0(t)  -  Xq ( t )  -  K0(t). 

Since  K0(t^)  •  A  ,  1-1,2,  we  have,  on 
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*  Kft(t) 


(e^i  +  et?_t 


and,  since  xQ(t)  -  x  (t1)et*  1  on  QittJ, 


- 2*.  (e4”4*  +  «t'-t)  -  *.(tt )•**-*  +  e4  J  «'*<ro-*0)«a. 

1  ♦  e  "  **  °  t  0 

1^6  t 


Differentiating  , 


-2* 


77^ 


-  2xQ(t| )  e4'*®4  ♦  x0(t)e-4 

-  2x0(t.)  e4‘-*4  +  x0(t,)et--te-t 

-  x0(t,)  e4**®4  . 


Thus 


x0(t 


> 

i  / 


2* 
1  + 


t8— t « 


2* 

TTT^ 


>  A 


x0(t«)  -  x  (t,)*11*12  -  - ^4 — r —  <  A- 

These  Inequalities  show  that  the  components  of  E  ■  |"t:  Kt(t)  < 
are  separated  by  non-degenerate  closed  Intervals  contained  in  the 
complement  of  E.  But  everywhere  in  the  complement  (since  K0(t)  £  \ 
for  all  t) 


T 

'X-  K0(t)  -  xQ(t)  -  fQ(t)  ♦  et  f  e"*(f0-x0)d« 

V 

so  that  fQ  Is  continuous  and  thus  differentiable  In  such  an  Inter¬ 
val  and 

T 


9e  t  -  (xQ(t)  -  fQ(t))  e  t  ♦  J  e“®  (f0-x0)ds# 

-*e-‘  -  -  fi(t))e_t  -  (x0(t)-f0(t))e“t  -e-t(f0(t)-«0(t) ) 


and  x^(t)  -  f'(t)  -  -Aor  f£(t)  -  x£(t)  +  A-  fQ(t)  -  xQ(t)  ♦  A  . 
Thus  f£(t)  -  f£(t)  -  x^(t)  -  f0(t)  -  xQ(t)  +  A  -  x£(t)  -A>  0, 
and  since  then  f0  cannot  be  non-negative  and  zero  at  two  points  we 
must  conclude  that  E  has  one  component. 

We  may  now  rule  out  the  possibility  that  E  has  a  component 
(r,s),  0  £  r  <  s  <  T,  for  then  ^ t :  K0(t)  -  A^contalns  [s,f],  and 
since  f£  ■  X  and  fQ(s)  »  0 

f0(t)  -  -y-  (t-s)2  ♦  k(t-s)  for  t  ^s. 

Since  f £  •  ,  x£  ■  f£  -  A  and 

*0(t)  -  -ng-  (t-s)a  ♦  (k-^)  (t-s)  ♦  xQ(s) 


hence 

-  Kq(T)  -  xq(T)  -  f0(T)  -  ->(T-S)  ♦  XQ(s). 


But  since  KQ(t)  <  KQ(s)  Immediately  to  the  left  of  s  we  have 
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0  1  K'(t)  «  K0(t)  —  xQ(t)  for  t  <  b  and  arbitrarily  close  to  s, 
so  that  ^  •  K0(s)  £  xG(s),  since  KQ  is  continuous  on  [r,sQ . 

Thus  since  8  <  T,  ?s>  0, 

-*(T-«)  +  x0(s)  -  A>  *0(»)  >  xQ(s)  -*(T-e) 

and  we  arrive  at  the  desired  contradiction. 

Finally,  then  we  know  that  KQ  -  A  on  an  Interval ,  fQ 
and  xQ  are  second-degree  polynomials  there  satisfying  f0(b)  •  0, 
x0(0)  •  1,  «  x^  +  the  polynomials 

f0(t)  -  (tJ-)'  +  k(t-b) 

x0(t)  -  (t-b)*  +  (k-wt  -  b*  +  i 

evidently  satisfy  these  conditions.  One  may  now  determine  the 

unknowns  b  and  k  from  the  conditions:  x^(0)  •  fQ(0)  -  1, 
b 

^*fQdt  *  a,  and  KQ(b),  which  yield  the  equations 

-/lb  ♦  k  b2  -  kb  -  1, 

a  -  *  b3  -  1/2  kb2  # 

^-1/2  Qk— >i)b  -  ba  ♦  l"^  (1  +  e2MT). 


^9.  The  Functional  Max  |  1-u  | . 

In  both  of  the  preceding  problems  we  have  found 
min  ^F(x):  G(x)  £  a^  for  two  functions  P,  Q  on  »  set  X;  such  a 
problem  has  a  natural  dual,  that  of  finding  min  £g(x):  F(x)  i  b  j. 

A  simple  and  quite  useful  relation  between  the  two  Is  furnished 
by  the  trivial 

Lemma.  If  xQ  Is  the  unique  xQ  furnishing  min  ^F(x):  0(x)  £  9^}  -  b 
then  xQ  Is  the  unique  x  furnishing  min  [g(x):  F(x)  ^  b]  ^  a. 

Proof:  Clearly  G(x)  £  G(xq)  £  a  Implies  F(x)  >  F(xq)  ■  b,  so  that 
F(x)  £  F(xq)  -  b  Implies  G(x)  >  G(xq). 

The  usefulness  of  the  lemma  is  apparent  In  the  following  prob¬ 
lem.  As  before,  let  x  be  the  absolutely  continuous  solution  of 
xf  -  —  x  ♦  f,  x(0)  >1,  and  consider  minimising 


(1)  max  | 1  -  x(t) | 
t 

T 

for  those  f feL*(0,T)  for  which  J*  fadt  £  b  <  T.  It  Is  not  at  all 

o 

apparent  that  there  Is  a  unique  minimising  f  In  this  case  until, 

utilising  the  lemma,  we  consider  the  dual  problem.  To  minimise 

$  f*dt  over  the  set  F  of  all  ffcL*  for  which  max  |l-x(t)|  £  a, 
o  * 

(or  1  —  a  £  x(t)  £1  ♦  a  for  all  t)  we  are  again  seeking  an  element 

f  of  minimal  norm  in  a  strongly  closed  convex  subset  of  La,  and 

this  element  is  unique.  As  we  shall  see,  for  0  £  b  £  T  there  is  a 

unique  a,  0  £  a  £  1  -  e-T,  for  which  the  minimizing  f  has  f2dt  ■ 

o 

so  that  f  minimizes  (l). 
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Thus ,  we  shall  proceed  to  solve  the  second  problem.  f  has 
the  obvious  property  that 

(2)  (f.f)  £  (f,g)  for  ge  P 

as  one  can  see  from  the  fact  that 

♦(*)  -  ll>r  ♦  (i-P0«!  I*  -  *(f.f)  ♦  (i-*)*(g.g)  ♦  2A(i-^)(f,g) 

has  its  minimum  at  t  Moreover  (2)  characterises  f ,  for  if 

hCP  also  satisfies  (2)*  then 

0  £  (f-h,  f-h)  -  Of.f)  -  (f.^Ii  ♦  D(h,h)  ”  (f»h0  i  0  end  h  -  f. 

By  means  of  (2)  we  may  determine  f  on  the  open  set  where 
1  -  a  <  x(t)  <  1  ♦  a,  or 

t 

(3)  (l-eje*  -  1  <  J  e®  f(s)ds  <  (Ua)et  -  1. 

o 

Indeed  for  each  component  1  of  the  set  we  have  a  constant  c  for 
which  f(t)  •  cet  In  I  .  Por  let  1Q  be  any  closed  subinterval 
of  I;  then  there  Is  an  Y|  >  0  for  which,  on  1Q# 

t 

(4)  (l-aje*  -  1  «-  Y)<  £  e8  f(e)ds  <  (l+aje*  -  1  -  ^ 

Now  If  for  some  g  vanishing  outside  IQ  we  have  (f,g)  +  0,  (eB,g)  -  0, 
then  f  +  6g  will  be  In  F  for  | C |  small  since  (3)  clearly  holds 
(for  f  +  6g)  for  t  outside  IQ,  and  holds  for  t  In  I0  by  (4).  But 
then  we  may  choose  the  sign  of  6  so  that  (f ,f+6g )»(f ,f )+6(f ,g)  <  (f,f), 
a  contradiction.  Thus  (es,g)  -  0  Implies  (f,g)  •  0  and  f(t)  •  cet 
In  IQ.  Since  1Q  Is  an  arbitrary  closed  subinterval  of  theqpen 
Interval  1,  our  assertion  is  proved. 
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We  must  now  resort  to  another  variation — that  of  T.  Let  us 
denote  by  PT  the  set  we  have  called  F  and  by  fT  the  element  of 
minimal  norm  in  this  set.  We  note  that  we  may  extend  fT  to  all 
of  (0,  oo ) ,by  setting  fT(t)  -  1  —  a  for  t  >  T,  and,  for  the 
extended  fT,  fTfcFT,  for  all  T*  >  0,  since,  trivially  for  t  £  T, 
<«%)'  -  (I-.).4,  .‘uptt)  -•THT(T)  -  (l-.)(»4-.T)  and 

^(t)  -  1  -  a  ♦  eT-t  |*t(T)  -  (1-aQ  £  1  -  » 

£  l  -  a  ♦  xT(T)  -  (l-a)  -  xt(T)  £  1  ♦  a. 

From  the  minimal  property  of  fT,  if  T  <  T*  then 

ij>  <p  f 

S f*dt  £  J*  f»,dt  £  S  fr*dt  £  /  fTdt  •  S  fTdt  ♦  (1-»)*(T'-T). 

o  o  o  o  o 

It  is  evident  from  this  relation  that  if  TR  — >  T  then  £fp  ^  is  a 
sequence  of  elements  of  F^  whose  norms  tend  to  the  minimal  norm. 

But,  as  is  well  known,*  this  implies  that  ^fT  |  converges  strongly 

to  fT  in  La (0,T) . 

Now  if  a  ^  1  then  f  >  0  is  in  F^,  so  that  we  need  only  con¬ 
sider  a  <  1.  In  this  case  f  •  0  is  in  ?T  for  T  £  TQ  •  log  l/l-a, 

clearly,  and  this  Is  not  the  case  !br  T  >  TQ.  For  T  >  TQ  we  have 

x^Cl)  -  l-a,  for  if  this  is  not  the  case  and  t_  is  the  least  t  for 

T 

which  J*  f*dt«0,  then  evidently  setting  fT-0  on  (tQ— 6#tQ)  for 
£>  0  small  yields  an  element  of  Fj  of  smaller  norm. 

♦ 

The  usual  argument  runs:  If  fn£F,  e  convex  set  and 
l|fnll  —milfoil  -  llfll.  then  ||fn-f0||»  ♦  ||fn+f0l|*  - 

2 1  I fn I  I*  +  2 1 | fQ | |*  so  that 

Hfn-foll*  “  2 1  |  f n  1 1  *  ♦  2 1 1  f  0 1  I  *  ~  »ll-ngg°  11*  <2||fn||*  -f  2 1  |  f  Q  |  |  * 
-  4||f0||* 


»  0. 
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As  a  consequence  of  these  facts  we  can  assert  that  Xp  Is 
non— Increasing  for  all  T  >  0.  Obviously  this  Is  the  case  for 
T  <  T_ ,  and  If  this  Is  not  true  for  some  ju  then  we  have  t,t', 

0  £  t  <  t'  £  T  for  which  <  Xp(t');  consequently  this  must 

hold  for  two  points  t,t'  In  the  open  set  where  1—  a<Xp(t)<l+a 
Indeed  for  two  points  In  the  same  component  I  of  this  set.  But 
on  I,  f(t)  -  cet,  xj.  •  —  *T  ♦  ce*  so  that  c  >  0;  consequently 
Xp  can  have  no  maximum  on  I  since  at  a  maximum  we  would  have 
0  •  xj,  -  -  Xj,  ♦  ce* 

0  £  xj  *  -  *t  ♦  c«t  *  ee*  >  0. 


Inasmuch  as  Xp(T)  -  1  -  a,  Xp  must  then  assume  the  value  1  ♦  a 
at  the  endpoint  of  1.  Thus  for  those  T  for  which  Xp  la  not  non¬ 
increasing  max  Xp  -  1  ♦  a,  while  on  the  complementary  set  max  Xp 

Now  aa  T  — >  T  we  must  clearly  have  x.  — >x_  uniformly  on 
n  *n  ~ 

any  finite  Interval  (0,K)  for 


|x-  (t)  -  Xp ( t ) |  •  e-t  |  S  ®8(fT  -  fT)d8 
An  o  n 


_2t  1/2  r 

<  (  Wi)  (  J  (fT  -  fT)*ds) 


1/2 


«  T_  T‘ 

o  n 


_2K  ,  1/2  Vn 

<  (  C-g~X  )  (J  (fT  -  fT)*ds) 

n 


1/2 


1 


where  T*  Is  the  larger  of  T  and  Tn»  Therefore,  the  set  of  T  >  0 
where  Xp  Is  non— Increasing  and  Its  complement  are  closed  subsets 
of  (0,  oo  ).  Since  the  former  Is  non-void  the  latter  Is  void,  and 
Xp  Is  non— Increasing  for  all  T  >  0. 
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The  form  of  fT  for  T  >  TQ  Is  now  clear:  fT(t)  -  ce*, 

0  <  t  fT(t)  -  l  -of;  $  <  t  £  T.  Let  us  set  l  -  a.  The 

relationship  between  §  and  c  Is  found  from  the  solution  of 
x*  •  —  x  ♦  cet,  x(0)  -  1,  that  Is 


(5)  x(t)  -  (1  -  §•  )»-*■  *  | 
by  virtue  of  the  fact  that  x($)  ■  oC  or 


(6) 


(1  -£)e~^  ♦ 


A 

If  we  denote  by  $>(c)  the  value  of  /  f*dt  where 

o 

ce*,  0  £  t  <  £  (c) 

9 

*  »  ?(c)  <  t  £  T 


r(t) 


then 


2% 

(7)  +(c)  -  ee  -S - +  **  (T  -$). 

2 

To  find  f^  we  must  now  minimize  4>(  c )  over  all  e,  where  $  and  c 
are  connected  by  (6),  and  c  must  satisfy  the  additional  constraints 
that  x  be  decreasing  and  0  £  $  (c )  £  T. 

Clearly  taking  o  <  0  la  Inferior  to  taking  e  •  0,  and  o  >  1 
yields  an  Increasing  x  so  that  we  need  only  consider  0  £  c  £  1 . 
Differentiating  (6)  we  obtain 

0  «  \  (e5  _  e“$)  ♦  (  *  e^  -  (l  -  £  )e“  ^ 


1  (ei  -  e  *)  ♦  (ce$-o<) 
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while  differentiation  of  (7)  yields 

4>*(c)  -  c(e2*  -  1)  ♦  (c2e2*  -Wa)  -Ji 

■  c(e2^  —  l)  —  *  (*<■  -  e-*)(ce*>  ♦  *) 

-  (e*»  -  e~^)(ce^  -  ^  ce^  -  j- °0 

-  ^  (e^  “  «"^)(ce£*  —  0()  • 


Moreover,  If  we  note  that  our  non— increasing  solution  x^  Is,  from 

(5) #  a  convex  comtinatlon  of  two  functions.  It  Is  evident  from  (6) 
that  3  increases  with  o.  Sines  ♦  •(e)  <  0  for  e/  <  <*,  +  •(*)  >  0 
for  ce  >o(.  It  follows  that  the  value  c*  provided  by  c*e  -  <K 

will  provide  our  minimum  if  <  T;  otherwise  (Bince  %  increases 
with  c)  ^'(c)  <  0  for  all  S,  <  T  and  we  must  take  £,  »  T.  Now  from 

(6) ,  (1  -|*7e-S*  - 


for  all  larger  T. 
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\ 


Consider  now  the  original  problem,  that  of  finding  an  f 
T 

with  C  f*dt  <  b  for  which  max  |l  -  x(t)|  is  a  maximum.  From 

0<t<T 


the  solution  f  to  the  dual  problem  Just  obtained  we  see  that 
J*  f*dt  is  a  continuous  function  of  a,  and  for  0  £  a  £  1  —  e 


-T 


It  Is  easily  seen  to  be  strictly  decreasing  with  values  T  and  0 


for  a  •  0  and  a  »  1  -  e 


-T 


Thus  for  each  b  In  the  range  0  £  b  £  T 


-T 


we  have  an  a,  0£a£l-e  for  which  the  corresponding  f 

provides  min  max  jl  —  x(t)|. 
t 
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